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ABSTRACT 

One promising avenue for increasing the utilxzation 
of institutional research data is the informal action research model. 
While formal action research stresses the involvement of researchers 
throughout the decision-making process, the informal model stresses 
participation in the later stages of decision making. Informal action 
research requires that researchers: have a fair amount of informal 
knowledge of pressing issues and of the decision makers at their 
institution; use informal communication channels ; ant icipate 
information needs before they arise; provide concise and timely data, 
solicited or not, in easy-to-read language; and use multiple channels 
for disseminating data. Three brief case studies illustrate the use 
of informal action research at Miami-Dade Community College (MDCC). 
In one case, data on the effectiveness of immersing students in 
remedial work during their first term, in contrast to integrating 
regular and remedial courses, were used in the formulation of policy 
regarding mandatory placement. In the second case, a student survey 
focusing on perceptions of high school preparation spurred joint 
action by MDCC and local public schools toward improving the quality 
of high school education. In the final case, a student flow model was 
developed to illustrate to legislators and administrators the 
potential impact of new testing requirements. Researchers may profit 
from the informal model as a way to show decision makers the value of 
data for their deliberations • (LAL) 
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Integrating Research into Decision Making: 
Providing Examples for an Informal Action Research Model 

Abstract 

The literature on action research delineates several crucial steps 
to ensure that research efforts will be used by educational institutions. 
Unfortunately, in many institutions of higher education researchers are 
consulted after solutions are implemented. This process bypasses most of 
- the major steps suggested for action research. It is possible, however, 
to participate in the later steps of the action research model and to begin 
to educate decision makers to the usefulness of research input. This paper 
presents three examples of descriptive data collection and presentation to 
influence decision making. An informal action research model is suggested, 
and related to each example. These examples may be useful to practitioners 
who are unable, for whatever reasons, to participate in decision making at 
all of the points specified by the formal action research model. 
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Integrating Research Into Decision Making: 
Providing Examples For An Informal Action Research Model 



Educational journals re-flect an increasing sophistication in research 
studies. State of the art computer software allows for complex statistical, 
analyses, and in some cases reproductions of computer pages themselves appear 
in lieu of simple tables (Bloom, 1983). The question remains, however, arc 
these increasingly sophisticated studies being increasingly used in decision 
making? 

The answer is not encouraging.. Hamberg (1978) notes that admin- 
istrative literature still vieWs institutional research as a neutral data 

J 

collection function in response to decision making. He strikes an optimistic 

i 

note by stating that research will become increasingly imnortant in college 

j 

management in the future. Braskamp and Brown (1980) conclude that traditional 



educational research does not m|ke a dif f erence--the results are not used for 
decision making. Hogan (1981) states that research conducted under the 
classical evaluation model does not work either. He notes that typically the 
evaluator is ^solely responsible for completing each step in the evaluation and 
works in relative isolation. The final report is usually submitted long after 
relevant decisions have been made at administrative levels. 

Weiss (1982) enlarges these observations to all of social science 
research. During the 1970's . there was a persistent complaint of data 
nonuti lization and the waste of research efforts. She argues, however , that 
while research may not supply a specific answer that policy makers employ, ii; 
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does shape the way they conceptualize issues. Research "widens the range of 
options that they consider,., and challenges some taken-for-granted assumptions 
about appropriate goals and appropriate activities 11 (p. 621). . Weiss (1982) 
also notes that the very fact that research units are incorporated into 
.institutions is an indication of a commitment to use information. If a 
commitment to use information does exist in our institutions, how might we 
build upon this to increase research effectiveness? 

One promising avenue for research effectiveness is the model called 
"action research". SinOe the late 1930s, action research has primarily focused 
on classroom settings and improved teaching practices (Best, 1970) . _An -early 
leader in the field described it as research that is "undertaken by those who 
may have to change the way they do things as a result of the studies" (Corey, 
1953). In the early 1980s, the action Research model has been proposed as one 
possible solirtion to the nonutil ization of institutional research data. The 
- key to the model is rts participant nature (Hogart, 1981). 

Action research stresses the involvement of researchers with decision 
makers throughout the decision making process. Researchers facilitate the 
gathering of information concerning user goals and problems, and they 
facilitate the problem-solving process itself. Action research generates 
information about needs, solutions, and implementations, and above all it gets 
information back to the users (Buhl arid Lindquist, 1981). The presumed key to 
action research is such user involvement with the entire research process, 
Wuch leads to a feeling ownership of the data by decision makers who /are 
"then very likely to use "the data. Action research is ncrt intended to advance 
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scientific knowledge but rather to provide knowledge -for immediate decision 
making (Buhl and Lindquist, 1981). 



Action research obviously implies -that researchers are involved in 
the discussion of issues early on. In this sense, the action research model 
.buys into the notion "t.hsrt decision making consists of purposeful or at least 
reasonably sequential acts. By stating that action researchers can help assess 
needs, solutions, and implementations, Buhl and Lindquist (1981) mean that they 
participate in the whole sequence of the decision-making process. Action 
researchers would not, for example, bis involved only after-the-fact in 
assessing policy implementation. 

Unfortunately, much decision making is less formal and more 
undirected than this. Simon 1 s (1957) classic study of administrative behavior 
recognized political and psychological factors. More recently, Weiss (1982) 
notes that policies may arise from unintended impacts of prior decisions 
(policy by default), officials may make impromptu accommodations 
(improvi s&t ions) with little lead time for research input, or direct political 

negotiations may occur where conflicting key interests are minimally satisfied. 

/ 

Responsible officials must take many factors into account, and when competing 
with these "factors, neither the time frame nor the climate "for decision making 
may favor the action research model. 

It may be possible, however, "to begin educating policy makers on the 
a^varrbagCS of the basic participant . nalTure^f action research at later stages 
of decision making. Linkage w/th ' research efforts can occur any time 
researchers are aware enough of decision makers 1 concerns to provide useful 



data to illuminate those concerns. In a setting of less structured decision 
making, 'this implies a fair amount of informal knowledge of pressing issues, 
and certainly implies several of Palola's (1981) suggestions. Among the most 
crucial of these are "get to the powerful 1 ' and "fit data to interests 1 * 
(Palola, 1981, p. 54)- He also suggests anticipating information needs before 
they arise. These sanie injunctions are echoed by Hackman (1983) who stresses 
the need to know your decision-makers and present data in a concise and 
reasonable way. 

For fchoee researchers who see themselves caught in a simple dz±a 

collection role, an informal action research model may be beneficial. The 

■\ 

basic "tene"ts of ^his informal model would include: . 



(I\^ Know your decision-makers and establish informal communication 

\ 

. \ channels (Palola, 1981, Hackman, 1983); 

(2) Anticipate information needs before they arise; 

(3) Provide concise and timely data, solicited or not, in easy to 
read language . (Lindquist , 1981) ; 

and (A) Get these data to the powerful using multiple channels, (Palola, 
1981) X 

\ 

\ ' 
The following\ paper presents three brief case studies of informal 

action research to aid decision making. These particular examples were chosen 

because of di-f-ferences in the poiicy makers involved, because the linkages with 

decision making occured at\ different stages, and finally because different 

channels of communication were used to inform the decisions . In all erf these 

examples^ participant linkage with the research effort was accomplished by 



informal discussions with key personnel. The most crucial factor in each case 
was knowledge of the pressing issuer facing decision makers, and the ability to 
provide "timely data for consideration. 

.-■ 

Example 1 - Reterrti on Rate and First Term Coursework 

This example illustrates research efforts to help inform new policy 
when -the existing "policy by default 1 ' was questioned. It also illustrates the 
provision of unsolicited data in a quick but useful manner. At Miami-Dade 
Community College students a.-e assessed for basic skills prior to registration, 
and are prevented from enrolling in certain courses if their test scores are 
below specified levels. Students must complete remedial coursework in the 
skill areas needing improvement before they are free to enroll in the 
corresponding college level course. This system does not mandate that all 
remedial work be taken immediately, but rather prohibits certain course 
selections until remediation is accomplished. The majority of the courses at 
the college are open iro students, and, as a result, students space their 
remediation ove,r several terms. 

iscussions began to occur among faculty and administrators about the. 

benefits of requiring remediation earlier in the students' careers. Concerns 

about the sequencing of Remediation came to the attention of researchers from 

t» 

informal committee contacts and from personal discussion with administrators. 
Several possible "solutions" were being considered. The most severe proposal 
was that of immersing students in remedial work during their very first term. 
FacuLty advisors expressed concern that this might have an adverse impact on 
Student retention. Students might be discouraged if they were not allowed to 



•take some program coursework during their "first "term. Administrators, on "the 
other hand, felt: that complertion of remedial coursework initially would lead to 
greater success and therefore increased retention. , 

This issue obviously was one with a need for some data. Because the 
issue seemed to be gaining the kind of momentum that often leads to a quick 
solution, there was not time to do a controlled study o-f immersion versus' 
non- immersion with subsequent retention as the outcome measure .. Data files did 
eKist, however, in which the validity of the placement instrument was assessed 
by looking at course? grades in developmental courses and the basic core 
(English and Math) courses during the first term of enrollment. The earliest 
of these files provided data such that a two-year retention rate could be 

determined. It proved relatively easy to add to this -file "total credits 

. / 
registered, for during the first term, so that any difference in credits between 

" " " " - / 

developmental plus core course credits and -the total Credits registered 
"indicated "that the student had taken some n other ,! coursework. 



A descriptive analysis was conducted using "the tested basic s^kills 
levels and combinations of first term coursework choices' (developmental^/ core , 



other) To set: up categories for grouping students . The outcome / measure 

/ 

examined was retention rate. This relatively simple . analysis revealed that 

/ 

retention rates, were* optimized when students selected a mixture/ of courses 
during trheir first term (other courses, as well as developmental /and/or core). 
The data were heavily qualified by the fact that we were unable TO identify the 
specific kinds of . extra coursework taken by students, birtr "the. consistency of 
"the findings in each student- category supported the notion of/ better retention 

When students were allowed to choose a course of interest / beyond the basic 

/' 
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requirements. This was particularly true -for students at the lowest basic 

/ 

skills levels where attrition is generally the greatest. Another interesting 
finding was that students who pursued only "other" coursework with no 
developmental or core type courses did not have increased retention. For the 
group as a whole, and quite strikingly "for part -"time students, -this type of 
course selection led to the lowest: retention rate. 

The data were summarized and issued as a short research report 
circulated -to the faculty and administrators who were involved with The issue. 
The effect of this study v^s to delay any hard and -fast decisions about 
immersing students in remedial work during their -first term. JKn attempt is now 
under way to identify progxain courses in each area -that a- student could 
profitably take while in the process of remediation. Thus, rather -than 
immersion, the policy seems to be aiming troward being more directive in what 
particular "other" coursework a student who is low in basic skills will be able 
to-taKe. 

Example 2 - High School Preparation 

«. • 

It is Clear to faculty and administrators alike that students are 

Coming to the college with deficiencies in basic skills. In "this example a 

definite problem was noted and research input was sought to help clarify the 

problem. The data gathered helped clarify some issues and needs which were not 

well articulated pxevXously. ^ n this Case, then, linkages with decision makers 

were established before any real decision making was perceived as necessary. 

The audience for the research was institutional administrators , but later 

expanded tro include public school officials. 



Administrators had a sense -that high school students would eventually 
seek posts econdary education at some "time in their careers. One question was 
whether the underprepared students had originally planned on attending college. 
Administrators were also sensitive to the fact that students mightr have 3 
negative attitude toward remediation once they were in college; Finally, as 
placement testing became well established and results were communicated to 
local high schools, the public schools themselves were concerned at the basic 
skills level shown by some of their graduates. 

In order to address these several concerns in a timely manner, it was 
decided to survey students— eiLr-oJLled--^^ Xhe. 
study was aimed at gathering retrospective comments about high school 
preparation and also at soliciting opinions about enforced remediation at the 
college. In this sense the study is another good example of Linquist's (1981) 
quick, but useful, action research. Along with the survey data, high school 
course selection was investigated by examining -transcripts for each student. 
The transcripts of the developmental/remedial students were contrasted with 
those from academically excellent (scholarship) students to look for 
differences in high school course patterns. 

Results of this study were striking. For many of the students .in 
remedial coursework, neither their original plans nor their high school 
curriculum reflected an intention to continue on to college. These students 
apparently later changed their minds and did enroll. Students were aware that 
too little was expected of them in high school, that they did not study, and 
they picked easy courses. There was widespread agreement among students that 
they -we^fe^inWware of the expectations they wquld be facing in postsecondary 



/ 

education. Finally , students commeirtecf "that they had been helped by basic 
skills courses art the college, that, they were better students now than in high 
school, and -that they did no*t mind taking remedial courses. 

Data -from the study were first summarized in an insi tutional research , 
report. Because of the importance and visibility of this issue, the 
administration of the college decided to publish the research as a separate 
monograph for wide circulation which included public school officials. Partly 
as a result of discussions of the monograph and the findings of the study, tho 
Boards of Trustees of the college and the public schools met and agreed to 
Initiate changes to improve the quality of high school education, particularly 
for those students" who — i-ndicated_jio^ intention of going to college.- These 
retrospective data were also summarized in a short documeTrt~~f or—high school 
students to try -to make them more aware of basic skills -that should be acquired 
while in high school. Although this was a quickly initiated study, the 
findings were significant enough that it was eventually published in "the 
College Board Review (Losak, Schwartz, and Morris, 1983). 

Example 3 - Existing Quality Control Versus Proposed New Statewide Testing 
Requirements 

This study is a good example orf a reaction to decisions being 
-formulated at the state level with little : . aput from 'the colleges. It also 
illustrates Hackman's (1983) comments on effective presentation of data, 
.particularly the use of algorithms . Finally, it demonstrates Palola's (1981) 

point that multiple channels for darta should be sought. "Bullets, 11 which are 

short -targeted responses, were used rarther heavily in this example. 

ERIC 9 ■ ._ 



A major issue in -frorrt of -the state legislature is how to improve 
quality education in the State o-f Florida. Several proposals were being 
discussed and it was clear that impact data were needed. The proposals 
included instituting a statewide admissions test for two-year colleges* denying 
admission on the basis of this test, and forcing students to return to high* 
school for remediation. These topics were subsumed at the State level under 
the general ruberic of quality control. 

Consultation with administrators revealed concern over possible 
impacts of these policies. In order to address this question, it was suggested 
that a hypothetical student flow model (algorithm) be developed that woujd 
Contrast current requirements with the requirements being proposed. Thia 
suggestion was well received, and the research office was formally directed to 
conduct a student -flow study. 

The particular "study" really amounted to the compilation of 
disparate pieces of data into a cohesive overview of the progress of students 
from ninth grade high school membership through community college graduation. 
As an example of some of the pieces of data that were combined, the flow 
included actual ninth grade membership, high school dropout rate, eventual 

graduation,/ entrance into postsecondary education, attrition at the 

/ 

post-secondary level, and associate degree completion. A second algorithm was 
developed which projected the hypothetical elimination erf students at different- 
stages . This included attrition of students who -failed the high school "exit" 
test*, screening out of students who would fail a college entrance test, and 
finally, the elimination of students who would fail the sophomore test required 
•for receiving an associate degree. Proportional rates ort failure art each of 




"these points were estimated as conservatively as possible in order tro make a 
convincing argument that would still be accepted by proponents of quality 
Control through testing. For example, estimates orf how many students would be 
excluded if a srta-fcfiwide college entrance test were established came from 
national normative data from placement tests currently in use at the College. 
A very low (15 percentile) hypothetical cut score was used on data already 
available art the Coll ?e. 

Data were summarized in a series of charts showing the impact on 
students Currently, and also with new testing requirements. The data were most 
striking and revealed the fact that considerable quality control already takes 
place in the classroom, in that almost a third of the ninth graders do not 
graduate high school, and only about one-third of the students who enter the 
open admissions ^college eventually graduate. The data also revealed that the 
new testing requirement would most severely impact blacks and Hispanics. Along 
with the prepared charts, separate pieces of the data were communicated to 
administrators. These included figures on the number of students who would 
presumably be sent back to high school for remediation, the number of students 
statewide who would be excluded from errtrance to open access institutions, and 
"the differential impact by ethnic category. 

The charts -themselves and the different impacrt findings at each point 
in "the student flow were used in community meetings and in lobbying efforts at 
the State level. These data were also released "to the local media and appeared 
in several editorials. As a result of this effort, reconsideration of the 
legislation occurred, and significant changes in *the original proposals took 
place. Tiiis "study" is an example erf the effective use of data where no formal 
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report was written, yet these d^ta received perhaps -the widesrt audience of any 
of the examples mentioned in -this paper. 

Cane I us ion 

The , action research model pinpoints key ingredients Tor research 
utilization. Optimal action research involves research participation at every 
Stage of decision making. When research studies focus on specific questions 
and concerns of users, the data are likely to be used. 

Concerns of decision-makers can be determined through processes less 
formal than those specified by the action research model. Research personnel 
can make an effort to stay informed about current issues through committee 
membership/minutes and through personal contacts with key administrators. The 
informal action research model suggested in this paper rests on anticipating 
information needs and providing timely data whether solicited or not. When 
unsolicited data begin to appear which clarify issues or problems, it is more 
likely that direct solicitation of research linkages will occur in the future. 
Example 1 in this paper involved unsolicited data. Example 3 occured at a 
later point in time and represents active seeking erf research input. 

It is hoped that researchers whose data are not currently being 
sought for decision making can profit from the informal model presented. As 
decision makers come to value the addition of data to their deliberations, the 
tenets of the more formal action research model may be able to be employed. 
Until such time, researchers need not simply wait to be asked. The pro-active 



ERLC 



stance suggested above may be a good bridge from no participation in decision 
making -to full participation at last. 
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